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(57) Abstract 



In luminance-priority multilayer color film, one of the layers substantially matches the luminance sensitivity of the human eye. This 
lummance layer distinguishes from prior art color films that have a blue, a green, and a red sensitive layer. This luminance layer has Ihe 
pnonty front position to sense light before being diffused and attenuated by other layers, giving the luminance record enhanced speed and 
clarity compared to prior art blue-priority color film. In another embodiment, a layered CCD sensor has a top silicon layer (1012) that is 
sensitive to all colors, followed by a yellow filter (1010). a second silicon layer (1008) responsive to green and red light only because of 
the yellow filter, a cyan filter (106), and a bottom silicon layer (1004) receiving only green light. An image from a luminance-priority color 
sensor inputs to a color space conversion to recover full color. In the prefeircd embodiment, a luminance layer on top maps to a luminance 
T«yf, , • f"** "^w'yng color sensitive layers arc used in conjunction with the luminance to derive the "U" and "V" chrominance vectors 
of YUV color space. 
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LUMINANCE-PRIORITY COLOR SENSOR 



BACKGROUND OF THE INVENTION 

Full color film must sense in three color dimensions. These three 
5 dimensions are sensed by three monochrome, or black and white emulsions, 
each acting as a sensor for a different spectral sensitivity, or color. In digital 
imaging terminology, each of these emulsions produces a separate color 
channel, or component of the full color image. Historically, there have been 
several topological arrangements of these sensors. The first color film, 

1 0 Duffycolor, used colored rice grains to create a red, green, and blue matrix 
over black and white film like a modern CCD matrix. Polaroid made an 
instant transparency film that lay red, green, and blue stripes over a black 
and white film, similar to the shadowmask in a color CRT. The original 
Technicolor process exposed three spatially separate color images on black 

1 5 and white film, created a separate dye transfer matrix from each, and dyed a 
single layer of receiving film with three dyes from the three matrices to make 
the theatrical print. It wasn't until the advent of Eastman's multilayer 
Kodachrome that a color film suitable for the mass market became practical. 
Today virtually all color film includes multiple layers stacked on top of 

20 each other. Light impinging on the film passes through all the layers. The 
layers have different spectral sensitivities, so depending on the color of the 
light, it will expose a specific layer. In most films, each layer also is given at 
manufacture a unique color coupler, or piece of a dye molecule, that will 
react with byproducts of development to form a full dye appropriate to the 

25 color sensitivity of that layer. After development, the silver image is bleached 
away, leaving a color image composed of dyes in layers. If you abrade a 
color film, black areas will first turn blue as the yellow layer is removed, then 
cyan, as the magenta layer is removed, and finally white as all layers are 
removed. 
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Kodachrome has multiple layers, but uses a unique process limited to 
reversal transparency film that does not require couplers to be stored in the 
undeveloped film. After a first development to expend to silver the exposed 
silver halide. the unexposed halide is flash exposed and processed In a 
5 developer containing its own color coupler. In Kodachrome the flash 
exposure is done one color at a time to flash one color layer at a time, 
followed after each flash by a developer with a coupler specific to the color 
sensitivity of that layer. Kodachrome development is very difficult, and only a 
few labs in the world process Kodachrome. However, by eliminating color 
10 couplers from the film during exposure, light scattering in the emulsion is 
reduced, giving Kodachrome an extra measure of clarity. Negative film gives 
a much wider latitude than reversal film, but in the prior art the Kodachrome 
process was limited to reversal film, and there was no way to obtain the 
latitude advantage of a negative film and at the same time the sharpness 
1 5 advantage of a film without couplers. 

Prior art color film was limited to operate in the RGB color space 
because each layer had to map to a specific dye that would develop an 
image, or color channel, that could be viewed or printed directly without color 
space conversion. Thus, a red sensitive layer was needed to generate cyan 
20 dye to modulate the amount of red light passing through the developed film, a 
green sensitive layer generated magenta dye, and a blue sensitive layer 
generated yellow dye. This traditional requirement of direct viewability of the 
chemically developed image placed a restriction on prior art color film to 
sense light in the RGB color space. Furthennore for pure colors to be 
25 recorded and viewed without color space conversion, the layers had to sense 
relatively pure red, green, and blue, without cross contamination of colors. 
For example, if the magenta fomning layer sensed blue light in addition to 
green, and the red sensitive layer sensed blue in addition to red, then a blue 
flower would expose not only the blue layer, but also the green and red, 
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forming a shade of gray when developed conventionally and viewed directly 
as a color image. 

Further, the depth ordering of sensitive layers of conventional color 
film was limited by the universal sensitivity of silver halide to blue light. Silver 
5 halide always is blue sensitive. In addition to this blue sensitivity, dyes may 
be added to trap the photons of other colors and couple them into the halide 
crystals. Thus a green sensitive layer is actually sensitive to both blue and 
green, and a red sensitive layer is sensitive to both blue and red. Green only 
and red only sensitive layers, which are needed for direct control of the 

1 0 magenta and cyan dyes, can only be realized by filtering out blue light with a 
yellow filter. In color film this is accomplished by adding a yellow filtering 
layer. This yellow layer must of course be placed above the red and green 
sensitive layers in order to filter blue light from those layers, and must be 
under the blue sensitive layer so as not to occlude blue light from that blue 

1 5 sensing layer. Thus in the prior art, the blue sensitive layer had to be on top, 
over the yellow filter and therefore over the red and green sensitive layers. 

Undeveloped silver halide scatters light with its milky consistency. 
When held up to the light, undeveloped film acts as a diffuser and attenuator. 
This can be observed while loading film into a camera. Each sensitive layer 

20 in color film degrades the image for lower layers, both by diffusing and thus 
blurring the light, and also by using, reflecting, and absortjing some of the 
light, thus dimming the light to lower layers, and requiring those layers to be 
more sensitive, and hence grainier. Only the top layer receives the full 
unattenuated, unblurred light. 

25 Because the human eye senses detail almost totally in the luminance, 

ideally the full luminance should be sensed in that top layer. Unfortunately 
only one layer can be on top. The next choice would be to make that one 
layer the green sensor because green is responsible for over half the 
luminance. But as we have just shown, the blue layer must be on top, 
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followed by a yellow filtering layer prior to the green. Blue is responsible for 
only about 10% of luminance, therefore the mandatory requirement that blue 
be on top means that almost alt the luminance is sensed at lower layers 
where the image is dimmed and blurred. Most of the advancement in film 
5 technologies has been in color film, and yet today a fine-art black and white 
print has a clarity and vivaciousness that is not matched by prior art color film. 

There have been historic and niche attempts to place green or red on 
top. Most interesting is color print paper which places blue at the bottom and 
red on top. The immediate question is how the red sensing layer is shielded 
10 from blue. Actually it isn't shielded, and in fact the red sensing layer is nearty 
as sensitive to blue light as to red. Several conditions unique to printing 
paper make this practical First, because the high contrast paper views a tow 
contrast negative, the density range of exposure needed to go from white to 
black is only about 10:1, as opposed to camera film that must respond over a 
15 1000:1 range, and a separation of 100:1 between red and blue is therefore 
adequate for print paper. Printing paper sees light that typically emanates 
from an orangish incandescent light, filtered by an orangish filter pack that 
removes typically 80% of the blue from the lamp, and is then focused through 
a negative that has the base orange cast of the coupler mask. The deep 
20 orange of the resulting light takes the place of the yellow filter level in camera 
film for the low contrast image of negative printing, and the blue sensitive 
layer is made about 100 times more sensitive than the red layer to 
compensate for the orange light, which is possible because of the relatively 
low base sensitivity of printing paper compared to camera film. 
25 The approach used in printing paper to put the red on top would not 

work with camera film because, first, the film must respond over a range of 
1000:1, not 10:1, second, the light coming through the lens is not deep 
orange, and third, even if it was, to match an ASA 400 red sensitivity, a blue 
layer 100 times more sensitive would need to be ASA 40,000, which would 
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be very grainy. Nevertheless there have been attempts to place the green 
layer on top. Despite the improvements mentioned earlier, the unavoidable 
color muting caused by crosscolor contaminations caused these attempts to 
fail to be accepted by the market. 
5 Although prior art color film senses with Red-Green-Blue channels, 

directly capturing three dimensional RGB color space, in image processing 
and storage other color spaces are possible that better exploit the needs of 
human vision. A common color space includes luminance and chrominance. 
Typically the luminance value is a blend of red, green, and blue in proportion 

10 to the sensitivity of the human eye, called by convention "Y^ The 
chrominance requires two values, which, with the "Y" value, define the three 
dimensions of color. A common representation of chrominance includes "U", 
which is luminance minus red, and "V", which is luminance minus blue. "U" 
and "V are thus color tints layered on the monochrome "Y" record. The 

15 human eye is much more sensitive to detail in the "Y' channel, and thus "U" 
and "V" can tolerate less detail and more grain. 

Color space conversion is a related art. Color space conversion maps 
an input suite of color channels into an output suite in a different color space 
or with different image colors. In a normal 3 dimensional color space 

20 conversion algorithm, three measurements at each image pixel, 
corresponding to the values at each pixel in each of the three sensed color 
channels, pass into the algorithm. That algorithm mathematically map 
through a function to provide three measurements, or colors corresponding to 
that image pixel, out of the algorithm. For example, in digital development 

25 with prior art conventional color film, as will be explained in more detail 
below, the "front" and "back" images containing blue and red are subtracted 
from the "through** image containing red, green, and blue, to yield just the 
green. A small portion of this green image is subtracted from the "front" 
image to yield the blue image, and the "back" image is mapped directly to 
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red. In this color space conversion, for each pixel front, back, and through 
measurements from the front, back, and through channels pass In and red, 
green, and blue pass out. Color space conversion can be employed with any 
suite of channels to map from one set of colors to another, for example, to 
5 map grays to blues. Although some color space conversions can be defined 
by equations, in the general case a lookup table can be employed to give 
any arbitrary conversion. 

A further related technology is direct digital development of images. 
This is a method of digitizing color film during development. The developing 

1 0 negative is scanned using Infrared so as not to fog the developing film. Color 
is derived from a silver image during development by taking advantage of the 
milkish opacity of unfixed silver halide to separate the 3 layers optically. 
Viewed from the top during development, the top layer is seen clearly, while 
the lower layers are substantially occluded by the milkish opacity of the top 

15 layer. Viewed from the rear during development, the back layer Is seen, 
while the other layers are mostly occluded. Finally viewed by transmitted 
light, the fraction of light that does penetrate all three layers is modulated by 
all, and so contains all 3. If the exposures of front, back, and through were 
mapped directly to yellow, cyan, and magenta dyes, a pastelized color image 

20 would result. However In digital development these three scans, front, back, 
and through, are processed digitally using color space conversion as 
explained above to recover full color. 

The Invention can also be practiced with layered sensors other than 
silver halide. A specific embodiment will be given for solid state sensing 

25 elements. Virtually all electronic imaging today uses silicon solid state 
sensors. When a photon strikes a silicon semiconductor, the photon knocks 
an electron from an atom, producing a hole-electron pair that allows a unit of 
charge to flow. Usually this charge is transferred to a small capacitor 
representing one picture element, or pixel, and this held charge is shifted in 
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sequence with the charge from other pixels in a CCD. or Charge Coupled 
Device shift register, into an amplifier. Thus a "CCD" is a specific 
arrangement commonly used to read information from an array of solid state 
sensing elements. 

5 A silicon solid state sensing element itself is sensitive to alt visible 

colors. A full color image may be sensed by splitting light into three colored 
images with dichroic mirrors, and sensing each image with spatially separate 
sensing arrays. Such 3 chip cameras are very expensive and bulky, are 
generally not sensitive in low light because of light loss, and require 
1 0 expensive optics to project a virtual Image of the lens aperture deep through 
the prisms. 

An alternate and more common approach to color attenuates light with 
colored filters, exposing each individual sensing element to light from which 
at least one color has been removed. Some cameras designed for still 

1 5 photography use red, green, and blue filters laid in a matrix, such as the 
Bayer matrix used by Kodak cameras that place green over half the sensors 
in a square matrix to create a green checkerboard interlaced with a quarter of 
the pixels under red filters and a quarter under blue filters. Some cameras 
designed for video employ cyan, magenta, yellow, and green filters laid in 

20 matrix allowing easy conversion to YUV as the signal is read sequentially 
from the chip. Other colors and arrangements are used also. All such single 
chip cameras suffer from several problems. First, light removed by the filters 
is lost to the sensors. A particular single chip camera is rated ASA 100 with 
the colored filters in place. With the filters removed in a black and white 

25 version of the same camera, the rated speed jumps 4 times to ASA 400. 
Second, the colored matrix itself interacts with image detail to create colored 
moire artifacts common In single chip digital cameras. Typical manifestations 
of these moire artifacts include one red eye and one blue eye, or a distant 
building with randomly red and blue windows. Third, the color matrix 
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reduces the effective resolution of the sensor an^ay, and attempts to reduce 
colored moire artifacts by blurring with an optical antialiasing filter reduce the 
effective resolution. 

The prior art has always believed that full color required sensors to 

5 operate in complementary color groups. The groups could include red, 
green, and blue, or cyan, green, magenta and yellow, but at least one color 
needed to be removed from each color sensor to complement some other 
sensor. This belief precluded the layering of a solid state sensor in which 
color response was incorporated with subtractive intertayer filters rather than 

1 0 variations in the color sensitivity of the layers themselves as In film, because 
it would have been impossible to remove any color for the top layer and still 
have it reappear for sensing at a lower layer. 



SUMMARY OF THE INVENTION 

1 5 A color image sensor responsive to light from an exposing light source 

which includes a first sensitive layer with a first spectral sensitivity. The color 
image sensor also includes at least one second sensitive layer with a second 
spectral sensitivity different from the first spectral sensitivity. The second 
spectral sensitivity is offset from the first sensitive layer in a direction 

20 perpendicular to the plane of the first sensitive layer. The first spectral 
sensitivity substantially matches the spectral sensitivity of the human eye. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 illustrates the structure of typical prior art color film; 
25 Figure 2 graphs the quantum detectabilities of prior art color film; 
Figure 3 illustrates the construction of luminance priority color film; 
Figure 4 graphs the quantum detectabilities of luminance priority color film; 
Figure 5 shows a system for practicing color space conversion; 
Figure 6 portrays color space mapping algorithms; 



wo 97/43613 PCT/US97/07901 

9 

Figure 7 illustrates the structure of a typical prior art CCD sensor; 
Figure 8 maps a prior art color matrix for a single chip color CCD sensor; 
Figure 9 graphs the quantum detectability of a prior art color CCD sensor; 
Figure 10 illustrates the structure of a luminance priority CCD sensor; and 
5 Figure 1 ^ graphs the quantum detectability of a luminance priority CCD 
sensor. 



DESCRIPTION OF THE INVENTION 

Referring now to Figure 1, the construction of prior-art color film is 

10 described. Construction begins with a structural base 102. Sensitive layers 
containing a silver halide emulsion are placed in thin films over this base. 
These layers contain silver halide with a native sensitivity to blue light. In 
addition, some of these layers have added to them a sensitizing dye to 
extend the sensitivity to other colors. First, a red and blue sensitive layer 104 

15 Is laid in a thin film over the base 102. A green and blue sensitive layer 106 
is placed over this. Then a yellow filter layer 108 is placed to absoriD blue 
light. Finally a blue sensitive layer 1 10 is placed on the top. Other layers not 
relevant to this discussion are omitted for clarity; for example, a layer on the 
opposite side of the base 102 sometimes is added to reduce halation and 

20 allow retouching, an overcoat protects all the layers, and furthermore each 
color sensitive layer is typically subdivided into three sublayers of different 
sensitivities. The details of the constmction of color film are commonly known 
in the art of color film manufacture, and may be found in references such as 
Michael Freeman, Film Making the Most of Films and Filters, Amphoto, 1988, 

25 and W. F. Berg, editor, Photographic Science: symposium: Zurich 1961, The 
Focal Press, London, 1963. 

Light consisting of a red light ray 1 12, a green light ray 1 14, and a blue 
light ray 116, impinges on the film. First in order from the direction of the light 
the blue sensitive layer 110 intercepts blue photons to generate a silver 
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latent image in the halide crystals of that layer at point 118. In addition, light 
of all colors is absorbed and scattered about equally by the blue sensitive 
layer 110, which appears grayish and opalescent to light. This absorption is 
illustrated by a thinning of light rays 1 12, 114, and 116. and by scattered rays 
5 120. The blue sensitive layer 110 is typically made thinner than the other 
layers to lessen the absorption and scattering at the expense or a grainier 
blue channel. 

Next in order from the direction of the light the yellow filter layer 108 
excludes the blue light ray 116 from reaching lower layers by absorbing it at 

10 point 122. Before reaching layers under the yellow filter, the green light ray 
114 has been attenuated and scattered by the blue sensitive layer 110. The 
green sensitive layer 106 intercepts the remaining green photons to generate 
a silver latent image at point 124. Finally, after having been diffused and 
attenuated by several layers, the red sensitive layer 104 intercepts some 

1 5 remaining red photons to generate a silver latent image at point 126. 

Figure 2 illustrates the spectral response of the sensitive layers 104, 
106, and 1 10 of Figure 1, The horizontal axis is wavelength in nanometers. 
The vertical axis is. in arbitrary units of quantum detectability, not sensitivity or 
speed. Quantum detectability is used here to mean the sensitivity to low 

20 contrast detail relative to an ideal photon counter. Quantum detectability is 
raised by sensing a higher percentage of photons (quantum efficiency), 
counting each with more equality (count nonunifonnity), minimizing 
nonphoton noise sources or grain (dark count, pixel nonuniformity), and 
reducing scattering (finer spatial distinction between an event, such as a star 

25 image, and the background). High speed and low speed films have roughly 
equal quantum detectability. A higher speed film utilizes larger crystals to 
gather light from a larger area. Although it may take less light to "expose" a 
high speed film, the larger grains give more noise to measurements and 
scatter light over a wider area so the ability to detect a detail, such as the 
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presence of a well focused star image, is no better with a high speed film 
than with a slow film that would retain the star image in a smaller area and 
measure its presence with less grain, or uncertainty. 

It is interesting how the thickness of a layer affects quantum 
5 detectability. Assume for a moment that the silver halide is totally transparent 
to light. Now a thick layer that is twice as thick as another thin layer may be 
modeled mathematically as two thin layers together. Each thin layer has a 
particular signal gain (contrast) and noise (grain). By adding the signals 
(channels) of the two thin layers together, one gets twice the signal, but the 

1 0 noise adds statistically to give square root of two more noise, hence the 
signal to noise ratio of a thick layer is square root of two better than a thin 
layer of half the thickness. If an ideal photon counter received twice the 
number of photons, the signal to noise ratio would improve by square root of 
two, again from statistics theory. Therefore the quantum detectability of the 

1 5 thick layer is twice that of the thin layer of half the thickness. This makes 
perfect sense because the thick layer would intercept just twice as many of 
the passing photons as the thin layer of half the thickness. This has assumed 
that silver halide is completely transparent to light. In fact silver halide 
absorbs some light, and hence lower portions of the film receive less light, 

20 and there is diminishing returns until finally the extra grain of a bottom layer 
would more than offset any gains in signal. Based on this, the designed 
thickness of film is an optimization problem in which too thin an emulsion lets 
valuable photons escape, and too thick an emulsion adds grain from lower 
layers that would receive very few photons. The optimization problem is 

25 particularly important with multilayer color film because any layer can be 
given priority over another layer by controlling both thickness and ordering of 
the layers. 

Continuing now with Figure 2. curve 202 illustrates the quantum 
detectability of the blue layer 110. It is seen to be quite low, as blue is often 



wo 97/43613 PCT/US97/D7901 

12 

sacrificed with a thin layer in an attempt to reduce scattering and attenuation 
of light. Curve 204 illustrates what the blue quantum detectability could have 
been if the blue layer were optimized in thickness for Itself. Of course If this 
were done, the green and red layers would suffer with very low quantum 
5 detectability. 

Curve 206 illustrates the quantum detectability of the green sensitive 
layer 106. Curve 208 illustrates what the quantum detectability would have 
been if the blue sensitive layer had not attenuated and scattered green light. 
This loss is significant because green is the primary contributor to luminance, 
1 0 and hence detail as perceived by the human eye. Curve 210 illustrates what 
the green detectability could have been if in addition the green layer were 
optimized in thickness for itself. There would not be a big improvement 
because green is usually given priority in light interception because it is the 
major contributor to luminance. 
15 Curve 212 illustrates the quantum detectability of the red sensitive 

layer 104. Cun^e 214 illustrates what the quantum detectability would have 
been if the previous layers had not attenuated and scattered red light. The 
difference between cun/es 212 and 214 is large because the thick green 
layer, along with the blue layer, has removed and scattered much of the red 
20 light. Because the red sensitive layer is at the bottom, it is already optimized 
in thickness for itself to make maximum use of whatever unscattered red 
photons reach the bottom layer. 

Finally cun/e 216 illustrates the overall sensitivity to luminance, which 
is a mix of about 50% of the green layer, 35% of the red layer, and 15% of the 
25 blue layer. The ratios vary with the dyes, and are different than the 
luminance values commonly known for television phosphors. The 
detectability is lower than any one layer by itself for an interesting reason. If 
the green layer had also been made sensitive to blue light by removing the 
yellow filter, then under green light one would see the response of the green- 
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blue layer and the grain of the green-blue layer. However the green-blue 
layer has filtered from it blue light. The blue response needed for luminance 
is added back in by adding in the response of a blue layer Now to green 
light one sees the same response of the green layer and the grain of the 
5 green layer, the same as if the layer had been green-blue sensitive. 
However now the grain of the blue layer is also added, so the overall 
graininess is worsened, and the quantum detectability reduced. 

Turning now to Figure 3, the construction of the preferred embodiment 
of luminance priority color film is described. As in the prior art of Figure 1 , 

1 0 construction begins with a structural base 302, a red sensitive layer 304, a 
green sensitive layer 306, and a yellow filter layer 308. The top layer 310 
distinguishes luminance priority film over the prior art. This top layer 310, 
which is in a plane perpendicular to the other sensing layers, is a sensitizing 
dye extending sensitivity to the green and red portions of the spectrum so as 

1 5 to generally match the luminance sensitivity of the human eye. In addition, 
the top layer 310 is thicker than the top blue sensitive layer 210 of prior art 
film to give priority sensitivity to this layer. Again, the manufacture of film is 
commonly known in the art, and in addition sensitizing dyes needed to add 
green and red sensitivity are commonly known and used in most black and 

20 white films to impart panchromatic sensitivity. Details of sensitizing 
emulsions with dyes are commonly known in the art. 

A red blue light ray 312 penetrates the top layer to generate a silver 
latent image at point 314. A green light ray 316 penetrates the film to 
generate two latent image centers at points 318 and 320. Also a red light ray 

25 322 penetrates the film to generate two latent image centers at points 324 
and 326. 

Figure 4 illustrates the spectral quantum detectability response of the 
sensitive layers 304, 306, and 310 of the luminance priority film of Figure 3 
for comparison with the responses of prior art film as given in Figure 2. The 
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axes are wavelength versus quantum detectability with the same units and 
magnitudes as used for Figure 2 for comparison. 

In Figure 4, curve 402 illustrates the quantum detectability of the green 
layer 306 and curve 404 Illustrates the quantum detectability of the red layer 
5 304. Note that both of these are lower than the equivalent curves 206 and 
212 from Figure 2 because the top layer is given a priority thickness. The 
green cun/e 402 may suffer the most because the green is no longer the 
prime bearer of luminance, but only the bearer of the green-magenta color 
axis to which the eye is least sensitive, and hence the green layer 306 may 

10 be thinner than the equivalent layer 106 to allow more light to the red layer 
304. The quantum detectability of the top panchromatic layer 310 is 
illustrated in curve 406 of Figure 4. This layer is both at the priority position 
on top and given priority thickness, and therefore curve 406 shows very high 
quantum detectability. 

1 5 The overall quantum detectability to luminance is illustrated in curve 

408. The height of this curve compared to the luminance detectability of prior 
art film, shown in curve 216 of Figure 2, is a major distinguishing benefit of 
the present invention over the prior art. Because most of the detail, and 
hence the impression of grain and sharpness, comes from luminance, a high 

20 luminance quantum detectability translates to an overall impression of higher 
quantum detectability. This could translate either to better clarity at an 
equivalent film speed, or a higher film speed at equivalent clarity when 
comparing luminance priority film to prior art film. 

The curve 408 is seen to slightly exceed curve 406 in the important 

25 yellow portion of the spectrum for an interesting reason. In the case of Figure 
2 described above, each color was sensed separately, and hence the 
detectability of the sum for any single color was less than the detectability of 
the layer specific to that color alone. In the case of Figure 4 however, a 
specific color, such as green, is actually sensed by two layers, namely the 
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luminance 310 and green sensitive 306 layers. After the gain of each layer is 
adjusted so the sum of the layers matches the luminance of the human eye, 
the signal is the sum of each gain modified layer, and the noise is the square 
root of the sum of the squares of the noise of each gain modified layer. 
5 The above will be explained using an example. For simplicity assume 

there was only the green and luminance layers, both had equal sensitivity to 
green, and both were modified by unity gain. Now the green signal would be 
doubled by adding the channels of the two layers together, but the random 
noise would add statistically for only square root of two more grain noise, so 

1 0 the signal to noise ratio would improve by the square root of two, and the 
quantum detectabiltty would double with this Increase, as explained before. 
Again, this is logical because under the above simplifying assumptions, the 
two layers would be sensing the green light equally, and this would be 
equivalent to the case of a double thick layer described earlier. This is 

15 distinguished from the case of a separate blue and green layer added 
together as described earlier, because in that case, to green light, only one 
layer was responding, and the second blue sensitive layer was adding no 
signal, only noise. In practice with two layers, the optimum compromise for 
the best signal to noise ratio would give a second layer a gain ratio, 

20 compared to the gain of a first layer, that equals the square of the ratio of the 
signal to noise ratios of the second to first layers divided by the signal ratios 
of the second to the first layers. Further detail may be found In references on 
statistical communication theory such as Parker, Sybil. Communication 
Source Book, McGraw Hill, New York, 1987. (TK5101.C6588 1988). 

25 The practical effect of the above discussion is now presented. In the 

case of luminance priority film, there are three layers added together, and the 
bottom two have lower quantum detection than the top luminance layer. 
Qualitatively, in the preferred embodiment of a red and green layer under a 
luminance layer, the luminance layer should be slightly deficient in red and 
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green, as would normally occur naturally as a result of the excess blue 
sensitivity of silver halide, and this deficiency made up by adding a small 
amount of red and green to the luminance channel derived from the scanned 
film channels during color space conversion. 
5 Continuing with the preferred embodiment, ideally the film would be 

manufactured for digital development. Such manufacture would not place 
color couplers in the emulsion, further enhancing the sharpness of the film 
compared to conventional film by reducing light scattering from the couplers. 
In digital development, the film is scanned with infrared during development. 
10 Because the silver image is scanned, colored dyes need never iorm and 
color couplers are not needed, even for negative film. Scanning is perfonned 
with reflected light from the front, separately with reflected light from the back, 
and separately with transmitted light through the film. Because of the 
opalescent nature of silver halide in the developer before fixing, the front 
1 5 scan sees primarily the top layer, the back scan sees primarily the bottom 
layer, and the through scan sees all layers in proportion to their thickness. 
Details on digital development may be seen in US patent number 5,465,155, 
Duplex Film Scanning, by Edgar, 

Alternately, the film could be prepared for conventional processing by 
20 including color couplers. These couplers could follow the same order as 
conventional film with the red sensitive layer specific to cyan, the green 
sensitive layer specific to magenta, and the luminance sensitive layer specific 
to yellow. If printed conventionally, such a film would produce very muted but 
recognizable colors. For quality results, such a film would require scanning 
25 followed by color space conversion, as will be described below. Blue is a 
difficult color to scan electronically because many light sources like 
incandescent and light emitting diodes are deficient in blue, negative films 
have an orange cast that filters blue, blue filters tend to be less efficient than 
other colors, and sensors based on silicon are relatively deficient in blue 
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compared to a flat spectrum. Because of difficulties with blue sensitivity, 
many electronic scanners produce excess noise in the blue channel. In the 
prior art, blue contributed so little to luminance that there was little motivation 
to fix the problem in lower cost scanners. However in luminance priority film 
5 the luminance channel is critical, and for reasons specific to some lower cost 
scanners, allocating the critical luminance layer to the blue modulating 
yellow dye is a bad tactical choice. 

For the above reason, the preferred embodiment places magenta 
specific coupler in the luminance layer, cyan specific coupler in the green 

10 sensitive layer, and yellow specific coupler in the red sensitive layer. 
Besides improving the film for electronic scanning, this complete color 
mismatch would avoid mistaken printing as conventional film. 

The spirit of the present invention is to include in a color film a layer 
that substantially and generally matches the luminance response of the 

15 human eye. This match does not have to be exact, and in fact a small 
deviation has been shown to be beneficial; therefore the word substantial 
should not be construed to mean that the match must be exact. The intent 
and purpose of providing a substantial match to luminance clearly 
distinguishes from the prior art in which the intent and purpose was for each 

20 layer to directly represent one of the specific colors red, green, and blue. 

Other luminance priority topologies different from the preferred 
embodiment will provide the major advantages of the present invention, even 
though they may be slightly less advantageous than the preferred 
embodiment. Several of these alternatives are now presented. This list 

25 should not be considered to be exhaustive or to express limitations. It is of 
course possible to exchange the positions of the red and green sensitive 
layers with neariy equal results. The pair of red and green sensitivities can 
be substituted for yellow, which is the sensitivity of panchromatic under a 
yellow filter, and green, or yellow and red. These combinations further 
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enhance luminance detectability at the expense of chrominance detectability. 
Further, the yellow filter may be moved further down or eliminated. For 
reasons discussed earlier, this would usually reduce detectability compared 
to the prefen'ed embodiment, however the advantages of the invention would 
5 still make such a film superior to conventional prior art films. 

Further, the luminance layer could approximate luminance with green 
and one other color. This could be green and blue, for what Is classically 
called orthochromatic sensitivity. The word orthochromatic means true color. 
A particularly interesting combination would place a thin blue layer on top. 

1 0 followed by a yellow filter, followed by a panchromatic layer responsive to 
yellow light as the luminance layer, followed by an orthochromatic layer 
responsive to green light. Note also that because of the color space 
conversion, there is no requirement for the different layers to match in 
contrast, as with prior art film designed for direct printing. 

15 Color space conversion is now described. As mentioned above, 

luminance priority color film can not be directly printed on conventional 
printing paper with color fidelity. The color channels from luminance priority 
color film must be operated on by a color space conversion to remap the 
colors in the film to the true colors. It is theoretically possible to do this 

20 mapping with color separations and color masking in an all chemical 
process, however such a procedure is not deemed competitive in a modern 
digital wortd. and so the preferred embodiment will disclose an electronic 
method. 

Figure 5 portrays two routs to electronically scanning a luminance 
25 priority Image on film into a digital data file. In the preferred embodiment, an 

* 

exposed luminance priority film 502 manufactured for digital development is 
input into a digital development machine 504. Details of this machine may 
be found in US patent number 5.465.155, by Edgar. This machine outputs a 
digital data file on line 506 connected to a computer 508, such as 
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manufactured by Apple computer corporation of Cupertino, California. 
Altemately, an exposed luminance priority color film 510 manufactured for 
conventional development is input to a conventional film processor 512. such 
as manufactured by JOBO corporation of Gummersbach, Germany. After 
5 processing, the film is input to a conventional film scanner 514 such as 
manufactured by Nikon corporation of Tokyo, Japan. The scanner outputs a 
digital data file on line 506 connected to the computer 508 for further 
processing. 

Further, an electronic imaging camera 516 using a luminance priority 

1 0 sensor, as will be described in more detail below, can be used to capture 
directly the luminance and chrominance channels and output these channels 
as a digital data file via internal conventional control and conversion logic 
518 on line 506 connected to the computer 508 for further processing. 

The computer 508 has attached to it a monitor 520 for display, a printer 

15 522 for printing, a keyboard 524 for data entry and control, an optical disk 
526 for data storage, and a modem 528 for communications. Internal to the 
computer 508 is a bus 530 for moving data between modules. Attached to 
the bus 530 are a processing module 532, input output module 534 to 
transfer data to the various peripheral devices attached to the computer, and 

20 a memory module 536. The memory module has stored internally an input 
image 538, an output image 540, and a control program 542 to direct 
movement of the images between the peripheral devices and to direct the 
processing module 532 to derive the output image 540 from the input image 
538. After deriving the output image 540, the control program 542 may direct 

25 the processing module 532 to move the output image 540 over the bus 530 
to the peripheral devices such as the monitor 520 for viewing, the printer 522 
for printing, the optical disk storage 526 for storage, or the modem 528 for 
transmission. Further details on the operation of a computer system for 
image handling may be found in references such as L. Uhr, K. Preston Jr., S. 
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Leviabli, MJB Duff, Evaluation of Multicomputers for Image Processing. 
Academic Press Inc. 1986. 

In performing color space conversion, normally there is an input image 
consisting of three channels. This means each pixel of the input image has 
5 three measurements, one from each channel, associated with that pixel. The 
conversion produces an output image consisting of three channels, meaning 
each pixel of the output image has three values, one for each channel, 
associated with that pixel. To perfonri a color space conversion, the 
algorithm must scan through each pixel of the image. This scan may be done 

10 by "nesting" two "loops", which are common terms in computer programming. 
At each individual pixel, the three input measurements are taken from the 
three channels of the input image. These three input measurements are 
processed by the color space conversion algorithm to produce three output 
values. These three output values are then placed in the corresponding 

1 5 pixel of the output image by placing them in the three channels of the output 
image. 

The input measurements may be the front, back, and through 
measurements of a digital developer, or the luminance, green, and red 
measurements of a luminance priority film in a conventional scanner, or the 

20 luminance, yellow, and green measurements of a luminance priority sensor. 
There may be four measurements, as in US patent 5,266,805 System and 
Method for Image Recovery by Edgar, that measures red, green, blue, and 
infrared. The output values may be the red, green, and blue values of a 
computer monitor, the XYZ coordinates of visual color space, the YUV or YIQ 

25 measurements of digital video, or even the four values cyan, magenta, 
yellow, and black sent to a printer. 

There are many methods of color space conversion to process the 
input measurements to the output values. For example, one could convert 
using classic linear matrix equations, such as is done in NTSC television. 
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The problem is that in most cas^ linearity is only an approximation. 
Sometimes the approximation can be improved by adding one dimensional 
nonlinearities to Individual color channels, such as in US patent 5,265,200 
System and Method for Automatic Image Saturation, Gamma, and Exposure 
5 Correction in a Digitizing Video Capture System, and US patent 5,469.275 
Method and Apparatus for Grayscale Adjustment, both by Edgar. In a 
luminance priority film manufactured anticipating color space conversion, 
there is no requirement that the different sensitive layers have equal contrast 
or even equal curve shape or equal spectral sensitivity versus exposure. 

10 Releasing the film of such requirements puts additional requirements on the 
conversion algorithm. In the case of digital developer where there is an 
interaction of different sublayers of different speeds for each color, the 
nonlinearities are very complex. 

A lookup table can handle very complex color space conversion in a 

15 simple algorithm. Suppose that the algorithm receives the three input 
measurements mentioned earlier. Suppose further that each of these 
measurements is an 8-bit value. In its simplest form, a lookup algorithm 
would concatenate these three 8-bit strings together to make a 24-blt string. 
That 24-bit string Is then used as an address into a lookup table that has an 

20 element for each possible combination of the three 8-bit input measurements. 
Each element of the lookup table contains the three 8-bit output values 
desired for that combination of input measurements. Once an element is 
addressed, the three output values may be read and copied into the output 
image. 

25 Such a table would be 12 megabytes long. This is not unreasonable 

in modem computers, and so this simple algorithm is given as the preferred 
embodiment. There are many ways to reduce memory requirement 
drastically at the expense of processing time. As an example, only the most 
significant 6-bits of each input measurement may be used in the 
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concatenation to cut the size of the lookup table to just 256 kilobytes. The 
truncated bits can be used to interpolate between elements of this much 
smaller lookup table, and recover most of the accuracy. 

The values in a lookup table must be pregenerated. Continuing with 
5 the preferred embodiment of a large lookup table, the values of certain points 
will be found empirically, and the rest wilt be found by interpolating these 
empirically derived points. To practice this method, a large number of colors 
are measured with test equipment to derive known color values in the 
desired output color space for each of the colors. Each of these colors is then 
10 exposed to a luminance priority sensor. The three measurements are then 
read from the sensor. The measurements from the sensor are used as 
explained above to access an element of the lookup table, and the known 
color value for that color is copied into that element. Whenever the sensor 
yields those exact three measurements again, a lookup will retrieve the color 
1 5 known to have generated those measurements. After finishing with the large 
number of experimental colors, there will still be blank elements in the large 
lookup table between the known elements. These are filled in by 
interpolating between close elements in the table of known value. 

Figure 6 illustrates the preferred embodiment of a color space 
20 conversion algorithm using a lookup table. Such an algorithm would reside 
in the control program 542 in memory module 536 of Figure 5, and would 
direct the processing unit 532 to process an input image 53B to produce an 
output image 540. Returning now to Figure 6, An input image 602 derived 
from a luminance priority sensor contains three color channels 604, 606, and 
25 608. These may be the front, back, and through scans from a digital 
developer processing luminance priority film. A pixel 610 is chosen from the 
input image, and that pixelOs corresponding measurements 612, 614, and 
616 from each of the three color channels are read from the image. These 
three measurements are concatenated into one address 618. This address 



wo 97/43613 PCrAJS97/07901 

23 

points to an element 620 in a lookup table 622. From this element are read 
three values 624, 626, and 628 that give the converted color. These three 
values may be the red, green, and blue components to drive a computer 
monitor. These three values are copied into the three color channels 630, 
5 632, and 634 contained by an output image 636 at an output pixel 638 
corresponding to the Input pixel 610. The above process is repeated for 
each individual pixel in the input image 602 to fill each pixel in the output 
image 636. When done, the output image 636, the same as output image 
540 of Figure 5. may drive a computer monitor 520 with a beautifully colored 
1 0 image. 

The invention of a luminance priority sensor is not limited to silver 
halide film. Luminance priority may be applied to nonsilver films. Further, it 
is not limited to chemical based phototechnology. A particularly useful 
application is In the direct capture of electronic images. Electronic image 
15 sensors include Vidicon tubes of yesteryear, arrays of cadmium sulfide 
semiconductors, and other technologies. Today the only practical electronic 
image sensors use silicon in a CCD array, and so the prefen-ed embodiment 
will be given using that available technology, not as a limit, but as an 
example. 

20 Figure 7 illustrates essential elements of a conventional silicon based 

Charge Coupled Device, or CCD, sensor. On a substrate 702 individual PN 
diode junctions 704, in a two dimensional matrix fomning an area array 706, 
are reverse biased. Normally no cun-ent flows in the reverse biased diode, 
however a photon 708 may knock an electron 710 from an atom of the 

25 semiconductor, leaving behind a hole 712. This hole-electron pair allows a 
quantum of current to flow in the diode junction, sensing the interception of 
the electron. This small amount of charge is collected in a charge shift 
register 714. On command from control logic 716, this shift register serially 
shifts the charge from each diode to another shift register 718 which shifts the 
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charges serially to an amplifier 720 and off the sensor for further processing 
along line 722. Such a topology is called an "area array", and is used to 
capture an image. 

Altemately a single row of diodes may output to a single shift register, 
5 or alternate diodes may output to alternate shift register on either side. Such 
a topology is called a "linear" or "line" array, and is used in conjunction with a 
mechanical scanning movement in a direction perpendicular to the line of 
diodes to capture a complete two dimensional image. Other topologies 
include several parallel lines of pixels which shift into each other as an image 
10 moves, called a Time Delay Integration, or TDl array. More details on the 
construction of electronic image sensors may be found in references such as 
M. J. Howes, D. V. f^organ, Charge-Coupled Devices and Systems, John 
Wiley & Sons, New Yorl^, 1980, and Roger Melen, Dennis Buss. Charge- 
Coupled Devices: Technology and Applications, IEEE Press, 1977. 
1 5 CCD cameras sense color in one of three ways. The first way makes 

three separate monochrome scans of an image, changing the light color or 
changing a colored filter over the imaging lens so one scan sees in red light, 
one in green light, and a final in blue light. This method was used for early 
color television, was used for color in early space flights, and is still used in 
20 many film scanners. Because the colors are sensed at different times, quality 
is severely degraded with moving subjects. A second way splits light with 
dichroic prisms into three colored beams, and places three area sensors, one 
in each beam. The sensors are placed In different planes because of 
different optical path lengths, and are offset laterally from each other, 
25 however the "virtual images" of the three sensors, as seen through the 
dichroic prisms, overlap each other in register. It is common in the art to align 
the red and blue sensitive sensors precisely on each pixel, called "co-site 
alignment" in the art. but to align the green sensor in a register offset by half 
the distance between adjacent sensing elements in a direction in the same 
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plane as the red and blue sensors. The effect of this is that moire seen by the 
red and blue sensors are repeated in the green sensor 1 80 degrees out of 
phase. Because luminance is comprised of approximately half green, moire 
effects tend to cancel in the luminance channel. Such so called "three chip" 
5 cameras produce beautiful images, and are almost universally used for 
professional studio work. They are expensive, they are bulky because of the 
prisms, they require special and expensive lenses to project a virtual 
aperture through the tunnel of the prism optical path, and In practice they are 
much less sensitive to dim light than so called "single chip" cameras. 

1 0 Referring now to Figure 8, the most common method of sensing a color 

image with a CCD sensor is described. In this method a color matrix 802 is 
laid in register over a CCD sensor 804 as in Figure 7 so that each diode 806 
has laid over it a color filter 808 to filter a light ray 810 bound for that element. 
There are several arrangements of the filters in common use. The Bayer 

1 5 array shown in Figure 8 is common in still image capture cameras. In this 
array, half the filter elements are green such as the filter element 808, 
represented by white in Figure 8. A quarter of the filters are blue, 
represented by black, such as the filter element 812, and a quarter are red. 
represented by a Crosshatch, such as the filter element 814. 

20 An immediate problem arises from the use of such a matrix. It is as 

though the scene were viewed through a colored screen. A point of light 
might randomly appear as a bright point of red, or of blue. Thin white lines 
around windows in a distant building might randomly map to green and blue 
sensors and appear blueish, or to green and red sensors and appear 

25 orangish. This common problem is reduced by blurring the image so a point 
of light is scattered over at least 4 sensors so all colors are covered. Such a 
bluning reduces the pixel count resolution by 4, and unless the blurring can 
have the negative brightness points of a "sine" function, does not totally 
eliminate the extraneous colors. These extraneous colors, called color 
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moire, after a French silk, has been a serious problem with prior art electronic 
image sensing using single chip cameras. 

"Two chip" cameras are a variation on "three chip" cameras. In this 
technology, a single non-color specific beam splitter divides all colors of light 
5 into two uncolored beams, and places two area sensors, one in each 
attenuated beam. Because the beams diverge, one sensor can not be in 
front of the other, or more precisely, the sensors can not be offset from each 
other in a direction perpendicular to the plane of either sensor. One of the 
sensors has no filter matrix, and is used to sense the luminance component 

1 0 of television video. The other has a color matrix, and is used to sense the 
color component of television video. Light reaching the color sensor is 
attenuated both by the non-color specific beam splitter and by the color 
matrix. To retain reasonable color signal to noise ratios, the color sensor 
requires light priority, and the luminance sensor can not be given priority as 

1 5 the light is divided. As a result, the sensitivity is as bad, or worse, than a 
"three chip" camera, and much worse than a single chip camera. In addition, 
the color matrix on the color chip introduces the color moire artifacts of a 
"single chip" camera, and the prism adds the bulk and expense of a "three 
chip" camera. The "two chip" technology is not popular because it combines 

20 the disadvantages of two prior art technologies. 

Figure 9 graphs the quantum detectability of a CCD array under a 
color enabling Bayer matrix. The ordinates show quantum detectability 
versus wavelength, as in Figures 2 and 4. Cun/e 902 represents detectability 
of an array with no filters. Because a CCD responds with equal current to all 

25 absorbed photons, and it absorbs photons with a nearly equal high 
percentage across the visible spectrum, it tends to be less sensitive to blue 
light when measured in a standard per unit power because each blue photon 
has more energy. Because the human eye is also deficient in blue, the eye 
has a better color match with silicon than with silver halide film. Curve 904 
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adds the infrared and ultraviolet filters needed for color imagery. The infrared 
filter also removes some of the far red to match the characteristics of the 
human eye. 

Curves 906, 908, and 910 represent color detectabilities under the 
5 color matrix filters. The green curve 908 is attenuated to at best half the 
height of curve 904 because only half the sensors see green light. Sensitivity 
is reduced further because no green filter passes 100% of green light. 
Similarly red and blue, shown in cun/es 906 and 910, attenuate to at best a 
quarter the height of 904 because only a quarter of the sensors intercept 

1 0 photons from each of those colors and three quarters of the photons of these 
colors are absorbed by opposition filters. Especially blue is reduced further 
because available blue filters pass much less than 100% of blue light. These 
reductions due to a reduced number of sensors are very real, but are typically 
ignored by just comparing sensitivities. What this is saying is that with fewer 

1 5 sensors exposed to a specific color, the statistical uncertainty noise rises in 
detecting the exact brightness for that color of any given area. The 
magnitude of the rise in uncertainty results in a reduction of quantum 
detectability for that color, even though the sensitivity of an individual sensor 
for that color remains the same. 

20 Continuing with Figure 9, curve 912 describes the overall luminance 

detectability of the sensor which, as described earlier, is slightly lower than 
each of the compositing color detectabilities 906, 908. and 910. A particular 
camera manufactured by Kodak is available with and without the color 
enabling matrix. Without the matrix for black and white, the camera is rated to 

25 be 4 times more sensitive than with the color matrix. The color rating is ASA 
100, which is inadequate for most available light work. Current solutions 
using night vision photomultipliers, such as used in astronomy and in the 
military, are very difficult and expensive to extend to color, and limit resolution 
and other aspects of image quality. This is a serious and limiting problem for 
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electronic image capture and must be solved before electronic cameras can 
compete with film for wide acceptance. 

Figure 10 illustrates construction of a preferred embodiment of the 
present luminance priority invention applied to a color CCD sensor. On a 
5 substrate 1002. construction begins with a conventional CCD sensor an-ay 
1004. such as portrayed in Rgure 9. Over this sensor a red absorbing, green 
transmitting filter 1006 is laid. This is also referred to as offset in register. 
This filter will be underneath a yellow filter, so it makes no practical difference 
if the filter is green or cyan. Over this filter another CCD sensor array 1008 is 
10 laid. This sensor must be built so the pixel site diodes are not opaque. This 
can be accomplished in certain topologies by using a transparent electrode 
for the underside and by making the junction thinner to not intercept all the 
photons. Over sensor 1008 a yellow transmitting filter 1010 is laid. Over this 
yellow filter a top sensor array 1012, similar to sensor array 1008, is laid. 
15 The thickness of the top and middle sensitive layers 1012 and 1008 

are both chosen to absorb about half the photons reaching the layer, and 
transmit the remainder. The bottom sensitive layer is built conventionally 
thick to use all the photons. The result is that about half the photons are 
absorbed by the top layer, about half of a half, or a quarter, are absorbed by 
20 the second layer, and the remaining quarter by the bottom layer. 

The yellow transmitting filter 1010 may simply absorb blue light. In the 
preferred embodiment, yellow filter 1010 is a multilayer dichroic filter that 
reflects the blue light. Such a filter may be made by depositing thin layers of 
material of alternating indices of refraction, as is known in the art for the 
25 manufacture of interference dichroic filters. The difference from common art 
is that the topmost layer does not have an air interface, and therefore an extra 
layer is required for the same degree of color discrimination. A description of 
the construction of such a filter may be found in references such as the 
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Product Reference Guide from Meltes Griot, 1770 Kettering Street, Irvine, 
California, 92714. 

Continuing with Figure 10, a red light ray 1014 Is seen to penetrate 
and stimulate an-ays 1012 and 1008 before being absorbed by the cyan filter 
5 1006. A green light ray 1016 is seen to penetrate and stimulate all three 
sensors 1012, 1008, and 1004. This would give green maximum quantum 
detectability. Finally a blue light ray 1018 is seen to stimulate only the top 
sensor 1012. In addition the blue light reflects from the dichroic yellow filter 
1010 to stimulate the top sensor a second time. Thus, although blue light 

1 0 only stimulates one sensor array, in effect it has the same detectability as if it 
had stimulated two sensor arrays because blue light stimulates the top array 
twice. Because the CCD is inherently more sensitive to red than blue, the 
sum of the two arrays sensing red Is In balance relative to the human eye 
with the one array sensing blue twice. Also the sum of the three arrays 

1 5 sensing green with no attenuation from the infrared or ultraviolet filters, brings 
green sensitivity into balance with the other colors relative to the sensitivity of 
the human eye. 

Because each point In the image has equal access to each of the 
three color planes, a bright point or a narrow white line would be sensed as 
20 the same color independent of its alignment with the matrix. Thus all color 
moire artifacts are eliminated with the current invention. 

Figure 1 1 graphs the quantum detectability of the three layers in a 
luminance priority CCD sensor, Cun/e 1102 is a copy of cun/e 904 from 
Figure 9 for comparison with the detectability of a monochrome array with no 
25 filters except for infrared and ultraviolet. 

Curve 1104 represents the detectability of the top luminance layer. 
The natural drop in the blue Is countered by the reflection from the dichroic 
filter layer under the sensor. The overall detectability of the luminance layer 
is lower than the cun/e 1 102 of a raw CCD imager because the top layer is 
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made thinner so as to allow light through to lower layers, thus it intercepts 
fewer of the photons and detectability Is reduced. Curve 1106 represents the 
detectability of the middle layer, and curve 1108 the detectability of the 
bottom layer. All the curves assume the top and middle layers absorb half 
5 and transmit half the light, the bottom layer absorbs alt the remaining light, 
and the yellow transmitting filter reflects blue. 

The overall luminance detectability is shown with curve 1110. Note 
that in the critical green part of the spectrum, because all three layers are 
sensing fully and therefore all photons are utilized, the quantum detectability 
10 of the layered luminance priority CCD sensor 1110 nearly matches the 
detectability of the unfiltered monochrome sensor 1102. There is no 
theoretical loss of detectability in the luminance channel by going to full color 
over a luminance-corrected monochrome camera. This is a dramatic 
improvement over the prior art represented by curve 912 of Figure 9, and 
1 5 makes practical a new world of available light to an emerging mass market of 
all electronic digital photography. 

In terms of freedom from color artifacts and image clarity, the present 
invention of a luminance priority sensor equals the prior art "three chip" 
technology. In size and eventual cost, luminance priority equals the prior art 
20 "single chip" technology. And in quantum detectability, the luminance priority 
color sensor equals prior art monochrome technology, and therefore exceeds 
all prior art color technologies. 

The spirit of the present invention is to include in an electronic sensor 
a layer that substantially and generally matches the luminance response of 
25 the human eye. This match does not have to be exact, and in fact in the 
preferred embodiment the luminance layer has an overabundance of red and 
blue. Therefore the word "substantial" should not be construed to mean that 
the match must be exact. The intent and purpose of providing a match to 
luminance by providing sensitivity to all colors clearly distinguishes from the 
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prior art in which the intent and purpose was for each layer to directly 
represent one of the specific color axes. An interesting analogy Is found in 
black and white film, where panchromatic film provides sensitivity to all 
colors, as is commonly said, "just like the eye". Even though the match of 
5 panchromatic film to the luminance of the eye is very approximate, there is no 
difficulty distinguishing it from a "colored" rendition through a green or red 
filter. In this invention, the phrase "substantial match to luminance" is to 
distinguish over the prior art "color" channel. 

Other luminance priority topologies different from the preferred 

1 0 embodiment will provide the major advantages of the present Invention, even 
though they may be slightly less advantageous than the preferred 
embodiment. Several of these alternatives are now presented. This list 
should not be considered to be exhaustive or to express limitations. 

The top yellow filter and bottom cyan filter can be exchanged with 

1 5 results that overall are nearly equal in quality. In this altemate embodiment 
blue is emphasized slightly instead of red. It would also be possible to make 
the top filter magenta, with the bottom filter either blue or red. but this would 
de-emphasize critical green. In all cases the top filter can be dichroic to 
emphasize the color being reflected. The lower filter can also be made 

20 dichroic. A particularly interesting combination would make the top filter 
dichroic yellow, and the lower filter dichroic magenta so green is reflected 
back to the top two sensitive layers for a second chance. 

While this invention has been described with an emphasis upon 
certain preferred embodiments, variations in preferred composition and 

25 method may be used and the embodiments may be practiced othenwise than 
as specifically defined herein. Accordingly, the invention as defined by the 
following claims includes all modifications encompassed within the spirit and 
scope thereof. 
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Claims 

1. A color image sensor responsive to light from an exposing light 
source, including a first sensitive layer with a first spectral sensitivity, and at 
least one second sensitive layer with a second spectral sensitivity different 
5 from the first spectral sensitivity, and offset from the first sensitive layer in a 
direction perpendicular to the plane of said first sensitive layer, wherein said 
first spectral sensitivity substantially matches the spectral sensitivity of the 
human eye. 

10 2. A sensor as in claim 1 wherein said first sensitive layer is located over 
the second sensitive layer offset in the direction toward the exposing light 
source. 

3. A sensor as in claim 2 wherein the first sensitive layer contains a 
1 5 plurality of solid state sensing elements. 

4. A sensor as in claim 3 wherein the substantial match to the spectral 
response of the human eye is the panchromatic spectral response of the 
solid state sensing elements. 

20 

5. A sensor as in claim 3 wherein the sensing elements are arranged in a 
linear pattern. 

6. A sensor as in claim 5 wherein the sensing elements are arranged in a 
25 plurality of parallel linear patterns. 

7. A sensor as in claim 3 wherein the sensing elements are arranged in a 
two dimensional planar pattern. 
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8. A sensor as in claim 7 wherein the second sensitive layer contains a 
plurality of solid state sensing elements arranged in a two dimensional 
planer pattern mapping in register to the two dimensional planer pattern of 
the sensing elements of the first sensitive array. 

5 

9. A sensor as in claim 7 wherein the second sensitive layer contains a 
plurality of solid state sensing elements arranged in a two dimensional 
planer pattern mapping in a register offset by half the distance between 
adjacent sensing elements in a direction coplanar with the plane of the first 

1 0 sensitive layer. 

1 0. A sensor as in claim 7 wherein a first filter layer acting to pass light of a 
first color is interleaved between the first and second sensitive layers. 

15 11. A sensor as in claim 1 0 wherein the first filter absorbs light of a color 
complementary to the first color that the first filter passes. 

12. A sensor as in claim 10 wherein the first filter reflects light of a color 
complementary to the first color that the first filter passes. 

20 

13. A sensor as in claim 10 including a third sensitive layer located under 
the second sensitive layer offset in a direction away from the exposing light 
source, and including a second filter layer acting to pass light of a second 
color and Interleaved between the second and third sensitive layers. 

25 

14. A sensor as in claim 13 wherein the first color includes red and green 
and excludes blue. 



wo 97/43613 PCTAJS97/07901 

34 

15. A sensor as in claim 14 wherein tlie second color Includes green and 
excludes red. 



16. A sensor as in claim 13 wherein the first color includes blue and green 
5 and excludes red. 

17. A sensor as in claim 16 wherein the second color includes green and 
excludes blue. 

10 18. A sensor as in claim 2 wherein the first sensitive layer contains a 
photosensitive chemical. 

19. A sensor as in claim 18 wherein the photosensitive chemical is silver 
halide. 

15 

20. A sensor as in claim 18 wherein the substantial match to the spectral 
sensitivity of the human eye by the first sensitive layer Is the spectral 
sensitivity of the photosensitive material so sensitized to include green and at 
least one other color. 

20 

21. A sensor as in claim 20 wherein the spectral response of the 
photosensitive material is orthochromatic. 

22. A sensor as in claim 20 wherein the spectral response of the 
25 photosensitive material is panchromatic. 

23. A sensor as in claim 20 wherein the spectral sensitivity of the second 
sensitive layer excludes the color to which the spectral sensitivity of the first 
sensitive layer most exceeds the exact spectral sensitivity of the human eye. 



wo 97/43613 



35 



PCTrtJS97/07901 



24. A sensor as in claim 20 wherein a first filter layer acting to pass light of 
a first color is interleaved between the first and second sensitive layers. 

5 25. A sensor as in claim 24 wherein the first color includes red and green 
and excludes blue. 

26. A sensor as in claim 25 including a third sensitive layer located under 
the second sensitive layer offset in a direction away from the exposing light 

1 0 source, and wherein one of the second and third sensitive layers includes 
sensitivity to red and the other one of the second and third sensitive layers 
includes sensitivity to green. 

27. A method of sensing a color image including the steps of sensing with 
1 5 a plurality of monochrome sensors with different spectral sensitivities, at least 

one of which substantially matches the spectral sensitivity of the human eye, 
to produce a plurality of measurements, and operating on the measurements 
with color space conversion. 

20 28. A method of sensing a color image as in claim 27 wherein the color 
space conversion includes the steps of assembling the plurality of 
measurements into an address, and addressing an element in a lookup table 
using the address. 
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